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Abstract 

Background: Monitoring of vital parameters is an important topic in neonatal daily 
care. Progress in computational intelligence and medical sensors has facilitated the 
development of smart bedside monitors that can integrate multiple parameters into 
a single monitoring system. This paper describes non-contact monitoring of neonatal 
vital signals based on infrared thermography as a new biomedical engineering 
application. One signal of clinical interest is the spontaneous respiration rate of the 
neonate. It will be shown that the respiration rate of neonates can be monitored 
based on analysis of the anterior naris (nostrils) temperature profile associated with 
the inspiration and expiration phases successively. 

Objective: The aim of this study is to develop and investigate a new non-contact 
respiration monitoring modality for neonatal intensive care unit (NICU) using infrared 
thermography imaging. This development includes subsequent image processing 
(region of interest (ROI) detection) and optimization. Moreover, it includes further 
optimization of this non-contact respiration monitoring to be considered as 
physiological measurement inside NICU wards. 

Results: Continuous wavelet transformation based on Debauches wavelet function 
was applied to detect the breathing signal within an image stream. Respiration was 
successfully monitored based on a 0.3°C to 0.5°C temperature difference between 
the inspiration and expiration phases. 

Conclusions: Although this method has been applied to adults before, this is the 
first time it was used in a newborn infant population inside the neonatal intensive 
care unit (NICU). The promising results suggest to include this technology into 
advanced NICU monitors. 



Introduction 

Basically, vital signals are physical quantities measured from the body and can be used 
to determine the physiological status and functioning. Examples of these signals 
include heart rate, breathing rate, body temperature and blood pressure. The normal 
range of vital signs varies with age, sex, weight, exercise tolerance and body conditions 
[1,2]. Nasal inspiration, the way neonates acquire air and hence oxygen, is important 
for maintaining the internal milieu of the lung, since ambient air is conditioned to 
nearly alveolar conditions (i.e. body temperature and fully saturated with water vapor) 
upon reaching the nasopharynx cavity. Essentially, respiration measurement can be 
performed by using nasal thermocouples, respiratory-effort belt transducer, piezoelec- 
tric transducer, optical sensor (pulse oximetry) and electrocardiography ECG. However, 
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all these techniques are inconvenient to take in at home and they may bring discom- 
fort and soreness to the patient [2-4], Apnoea (abrupt stopping of respiration) and bra- 
dycardia (rapid decrease of heart rate) are common and serious problems in premature 
infants. One of the methods to quantify respiratory rate in these infants is to use a 
thermistor that is fixed above the upper lip directly in front of the nares. This by itself 
can induce apnoeas because of upper respiratory airway obstruction. Therefore, one of 
important field in such monitoring system is neonatal intensive care unit (NICU), 
where the patients (neonates) need continuous monitoring of such vital signs (e.g. 
respiration rate) without creating a discomfort or irritation to them. In principle, opti- 
cal, electromagnetic, acoustic, and pneumatic techniques can be employed to realize 
noncontact measurement of physiological quantities. Wang et al. [2] performed a study 
on non-contact detection of breathing and heart beat based on radar principles. Simi- 
larly, Droitcour et al. [5] developed a respiratory rate monitoring system using a non- 
contact, low power 2.4 GHz Doppler radar system and obtained good results when 
monitoring breathing activities for hospitalized patients. De Chazal et al. [3] modified a 
biomotion sensing technique for respiratory activity detection based on 5.8 GHz Dop- 
pler radar. Hafner et al. [6] developed non-contact cardiopulmonary sensing with a 
baby monitor for premature infants inside neonatal intensive care unit (NICU) by 
using simple Doppler radars operating in continous wave (CW) mode. Moreover, Zito 
et al. [7] developed a wearable system-on-chip (SoC) ultra wide band (UWB) radar for 
contactless cardiopulmonary monitoring. Matusi [8] has proposed a novel approach for 
touchless measurement of heart rate variability (HRV) by using a combination of 
microwave radar and infrared thermography to analyze the exhaled CO/C0 2 gas con- 
centrations. Furthermore, Mathews et al. [4] also prototyped a contactless vital signal 
monitor which uses very low power, high frequency Doppler radar to detect the 
respiration and heart rates. Ling et al. [9] introduced the OxyArm module, which is a 
new minimal contact oxygen delivering system for mouth or nose breathing. Moreover, 
Hoffmann et al. [10] developed a capacitive textile force sensor for detecting respira- 
tion activity rate in the human body. Additionally, Nakajim et al. [11] employed a real- 
time image sequence analysis of CCD video camera for evaluating posture changes and 
respiratory rate of a subject in bed. Moreover, Heimann et al. [12] investigate a new 
non-contact monitoring method of heart and lung activity using magnetic induction 
measurement. In premature infants, a thermistor was used to quantify respiratory flow 
during inspiration and expiration with the disadvantage of a possible obstruction of the 
upper airways. 

In contrast to the infrared (IR) detectors, which measure the radiation energy 
emitted from any object containing solid matter, that may represent an option for pas- 
sive non-contact measurement of vital signs including respiration activity [13]. Resume 
to that, the skin is the largest organ of the human body and helps maintain the ther- 
mal equilibrium of the body and the environment through a heat transfer process. 

Infrared thermographic imaging 

Any object whose temperature is above absolute zero Kelvin (-273.15°C) emits radia- 
tion at a particular rate and with a distribution of wavelengths. This wavelength (X) 
distribution is dependent on the temperature of the object and its spectral emissivity 
e(A,). The spectral emissivity, which can also be considered as the radiation efficiency at 



Abbas et al. BioMedical Engineering OnLine 201 1, 10:93 
http://www.biomedical-engineering-online.eom/content/10/1/93 



Page 3 of 1 7 



a given wavelength, is in turn characterized by the radiation emission efficiency based 
on whether the body is a black body, grey body, or a selective radiator. Around room 
temperature, the typical emissions for a solid matter are maximal in the long wave 
infrared (LWIR) region of the electromagnetic spectrum (7 ptm to 14 /mi) (see Figure 
1). In principle, the hotter the object, the higher its maximal frequency of radiation, 
that moves towards the visible region. While IR radiation is invisible to the human eye, 
it can be detected and visualized by special IR cameras. These cameras detect the invi- 
sible IR radiation emitted by an object and convert it to a monochrome or multico- 
lored image on a monitor screen, in which the various shades or colors represent the 
thermal patterns across the object's surface [1,14]. In one specific medical application 
the thermal imagers may be coupled with proper computer software to detect febrile 
temperatures on the skin of passengers (epidemic screening). Temperature readings 
over time may also be registered. Although thermal imagers offer an excellent means 
of making a qualitative determination of surface temperature, there are difficulties in 
obtaining absolute measurements. 

Target's surface radiation heat exchange 

The measurement of IR thermal radiation is the basis for non-contact temperature 
measurement and thermography. Fundamentally, thermal IR radiation (W) leaving a 
surface (A) is called exitance' or radiosity. This energy W can either be emitted from 
the surface, reflected off the surface, or transmitted through the surface (see Figure 2) 
[14,15]. Note that the total radiosity is equal to the sum of the emitted component 
(W e ), the reflected component (W r ) and the transmitted component (W t ). Thus, the 
surface temperature is related to W e , only on the emitted component [15,16]. Gener- 
ally, the infrared radiation impinging on the surface can be absorbed, reflected or 
transmitted, as shown in Figure 2(b). Basically, Kirchhoff s law of thermal radiation 
states that the sum of the three components is always equal to the received radiation. 
Hence, the sum of the three components, if the percentages are expressed as fractions, 
equals unity 

a (absorptivity) + p (Reflectivity) + x (transmittance) = 1 (1) 

Therefore, each part of these physical quantities has a value equal to less than one, 
as can be seen in the three radiation components in Figure 2(a). For further simplifica- 
tion, if the IR thermal energy detector is positioned in front of the target surface, then 
the net radiation (W net ) which will be detected is equal to the transmitted component 
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Figure 1 The electromagnetic spectrum. The electromagnetic spectrum showing the infrared radiation 
classification and corresponding wavelengths, (® MedIT, 2011). 
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Figure 2 Heat radiation mechanism. Heat radiation mechanism (a) The radiative heat flow mechanism, 
where total exitance or radiosity equal to the sum of reflected radiation W r = e.cr.T^, transmitted 
radiation W t = e.cr.Tf and emitted radiation W e = s.cr.T^, (b) The concept of impinging the process 
of radiation on a target surface, where (1) is the total radiant energy, (2) heat source,(3) absorbed energy, 
(4) reflected energy, (5) transmitted energy, (6) total detected energy and (7) total surface properties (® 
MedIT, 2011). 



of the IR thermal radiation (see Figure 2(b)) [1,13,17]. 

Wr* = W T =T- W tot 



(2) 



This means that the other two physical quantities (absorbed and reflected radiation) 
will not be considered in IR thermal imaging. 

Material and Methods 

Clinical Acquisition of IR Thermograms 

The real-time IR thermograms were collected using a VarioCAM® hr head IR camera 
(InfraTec GmbH, Germany) with a thermal sensitivity of 0.05°C at 30°C. This device 
allows IR image transfers via the IEEE- 1394 Firewire data interface at 30 frame per sec- 
ond (fps) frame rate. The scaling temperature sensitivity scheme in the infrared radia- 
tion range of 1 ftm to 14 ftm was set to a range of 0°C to 40°C. Preprocessing steps 
(such as filtering, color scale conversion and image scaling) were done using IRBIS® 
professional software. Figure 3 shows the imaging setup for neonatal thermal respira- 
tion (IRTR) measurement. The acquisition protocol for the IRTR measurement con- 
sists of three distinct phases with 2 minute duration for each phase, and between these 
phases intervals, there is a recalibration time to correct any non-uniformity with IR 
themrography (IRT) (see Figure 4). Note that, the observation phases from the bedside 
monitor have the same phases. Furthermore, at the initial measurement time, a localiz- 
ing of neonate's nostrils region to make sure that full coverage of IRTR signature is 
performed. 



Patient population 

All measurements were conducted at the Department of Neonatology (RWTH Aachen 
University Hospital). This has been approved by the Medical Ethics committee of the 
RWTH Aachen University Hospital, issued on 19 August 2009 (EK032/09). We exam- 
ined seven premature infants with a median gestational age of 29 weeks. They were all 
consecutively admitted directly after birth to our Department of Neonatology. We 
excluded infants with additional risk factors apart from prematurity, e.g. chromosomal 
abnormalities or brain haemorrhage. Study design and protocol were approved by the 
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Figure 3 IRTR clinical imaging setup. Schematic of the experimental setup used for the neonatal infrared 
respiration monitoring technique. The IR camera is located 70 - 80 cm from the neonate and is connected 
to the IR acquisition/analysis workstation. The infant's nostrils have to be in direct optical contact and 
visible, the overall setting consist of (1) radiant warmer bed, (2) bedside monitor,(3) camera field of view 
(FOV),(4) IR thermal camera, (5) analysis workstation and (6) infant under NIRT imaging (® MedIT, 201 1). 



Ethics Committee of Aachen University Hospital and parental consent was obtained 
prior to enrollment. None of the infants was mechanically ventilated. They all had 
respiratory support via CPAP (Continuous Positive Airway Pressure) directly after 
birth because of respiratory distress syndrome, a very common disease in these infants. 
One of them still had a CPAP during the study. While five infants were handled in an 
incubator, two infants were positioned in an IR radiant warmer bed. Cardiorespiratory 
stability was a precondition to be included into the study to get a reliable signal over 
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Figure 4 IRTR measurement protocol. The IRTR signal measurement protocol which include three 
phases and in between a recalibration phase to compensate any non-uniformities within infrared 
thermography imaging. 
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the whole time period of the IRT. During IRT, vital parameters including oxygen 
saturation were continuously monitored to make sure that there were no negative side 
effects. The authors are aware that this setup and this heterogenous patient population 
can not be a basis for a rigid clinical validation study. Instead, with this paper we are 
presenting a method for automated data analysis which may eventually lead to a valid 
ventilation monitoring technique. 

IR thermography post-processing 

The acquired thermographic images were exported to MATLAB® for post-processing 
and pre-filtering. The mean value was removed by a moving average filter. Motion 
compensation was applied using the trend-remove function of the MATLAB System 
Identification toolbox. The distance between the camera and the subject was kept at 
less than 150 cm in order to attenuate background IR radiation from the surrounding 
objects, and to eliminate geometrically induced disturbances. Initially, raw thermal data 
was used to construct time-varying signals for each thermographic pixel in the area of 
interest in order to build temperature time profile. However, this approach makes the 
signal extremely noisy due to variation in the ambient temperature of the surrounding 
region of interest (ROI) [18-21]. In our work, the thermal images were examined at 
different points in time. All frames that carry information relevant to respiration in the 
ROI were selected. Following these steps, the time-varying signals from each point in 
the ROI were averaged and continuous wavelet transform (CWT) was applied. The 
resulting waveforms yield excellent results to identify infrared thermography respira- 
tion (IRTR) signals [22,23]. The preliminary tests were conducted in our neonatal 
intensive care unit (NICU) to identify IRTR signals in neonates; stability over the mea- 
surement time intervals has been proven. 

Respiration thermal signature 

Many physiological phenomena occur in the spectral band of long wave infrared 
(LWIR, 7 /urn to 14 /mi); however, in some bioheat transfer processes, these phenom- 
ena also take place in the range 3 /mi to 8 ftm mid-wave IR (MWIR) [13,14] or in the 
range of 0.7 /mi to 2 /mi short-wave infrared (SWIR) [15]. For example, Pavlidis et al. 
[1,20,24] used MWIR sensors for distant measurement of cardiac and breathing rates 
in adults. In this work, the breathing measurements were based on heat transfer of the 
moisturized air during expiration, which is directly related to the respiration waveform. 
Although the exact shape is smoothed, it was shifted and noisy with respect to the 
actual respiration rate. Most probably, this is mainly due to the diffusion-convection 
heat transfer processes and air flow in the nasal cavity [7,13,17]. Note that the anato- 
mical section of a nasal cavity (shown in Figure 5) also consists of vascular mesh, 
which contributes to the temperature conditioning of the inhaled air. As indicated, for 
breathing measurements, Palvidis et al. [1,18,20,23,24] used the expired and moistur- 
ized air flow to measure the respiration rate. As a result, the subject must have a side- 
view technique to the camera in order to visualize breathing -jet dynamics. Beside this 
side view orientation, Pavlidis also introduced the concept of nostrils tracking in adults 
[18,20,23]. Our method presented here is related to this concept, but differs in the 
spectral range. Also, signal processing was enhanced. While other groups [20,23] used 
MWIR, our group used LWIR thermography, which is more stable in detection of 
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from ambient 

Figure 5 Physiology of heat transfer processes inside nasal cavity (a) Anatomical section through the 
nasal cavity, showing the mechanism of heat exchange between the internal tissue lining and the flowing 
air inside the nasal cavity (inspiration-expiration phase) which consist of the following: (1) convective air 
flow inside nasal cavity, (2) perfusion heat transfer inside nasal blood vessels, (3) convective heat loss over 
mucosal film, (4) conductive heat loss of mucosal film on nostrils inner lining and (5) radiative heat loss 
from nostrils tissue, (b) schematic representation of heat transfer processes inside the nasal cavity, (® MedIT, 
2011). 



temperature variance within the thermographic scenario [13,15,22]. In general, LWIR 
cameras are typically preferred for imaging applications that require absolute or rela- 
tive measurements of object irradiance or radiance because emitted energy dominates 
the total signal in the LWIR. In the MWIR, extreme care is required to ensure the 
radiometric accuracy of data. Thermal references may be used in the scene to provide 
a known temperature reference point or points to compensate for detector-to-detector 
variations in response and improve measurement accuracy. This temperature reference 
measurement in our case is not possible, because this will include invasive nasal ther- 
mocouple and may interfere with our thermography image reading. Moreover, besides 
a characterization of the respiratorial behaviour, we focused on temperature changes in 
the nasal region (nostrils) within the thermal image to get possibly information about 
the impact on thermoregulation of the infants. Additionally, the thermal imaging was 
performed using both frontal and lateral views, in order to follow the defined region 
over the nostrils. 

Infrared Thermography Respiration (IRTR) signature detection 

Basically, this type of thermographic imaging may be called "pulsed thermography", 
which implies that the process is repetitive in nature, which is true for the respiration 
rate. Therefore, it is essential to develop a method to detect a biphasic thermal breath- 
ing signal, which consists of two phases (active and passive states) [15,20,25]. Initially, 
during the application of infrared thermal imaging on newborn infants for mapping 
skin temperature, we were expecting to detect very small temperature changes in the 
nostrils region comparing to the magnitude in adults [20,23,26]. Therefore, we 
expected difficulties to detect the respiration thermal signature in infants, and were 
supposed to find this temperature difference between inspiration and expiration phase 
in the range between 0.3°C to 0.7°C. The physics of this phenomenon are based on the 
radiative and convective heat transfer component during the breathing cycle (see Fig- 
ure 5). In fact, including all these influences in one model is a complex task, but 
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should include the simulation of the airflow pathway, temperature gradient distribution 
throughout the nasal cavity, and the blood perfusion in the nasal cavity and nostril 
regions [18,25]. Hence, the mathematical approximation for the IRTR signature 
depends on the five main parameters shown in Figure 6, and the total heat flow rate 
(Qi?i?(0) contributing to the thermal signature of one respiration cycle can be 
expressed as follows: 

Qitt(t) = Qrad(t) + Qconv{t) + Q evap {t) + Qperf{t) + Qlatent{t) (3) 

The overall equation for heat transfer inside the nasal cavity at the nostril level will 
be equal to the summation of the following heat flow components: 

♦ Q rad : rate of heat dissipated by radiation between the air flow and the nasal 
surface 

♦ Q conv : rate of heat dissipated by convection between the nasal inner lining (skin 
and mucosa) and air flow 

♦ Qevap- rate °f neat dissipated by evaporation at the nasal surface (mucosal thin 
film) 

♦ Qperf- rate °f neat dissipated by blood perfusion 

♦ Qhtenv rate °f neat dissipated by latent heat loss through the respiration air flow, 
where the convective component is negligible in the inspiration thermal signal, due 
to outflow air with a temperature equal to the tissue temperature [20,27]. 

The convective heat transfer Q conv of air flow over the inner lining of the nasal cavity 
and mucosal patches, where this convection is described by Newton's law of cooling, 
means that the rate of heat loss of a body (nasal cavity) is proportional to the differ- 
ence in temperature between the body and its surroundings. Therefore, the rate of 
convective heat transfer is given by 

Qconvit) = k ■ A ■ {T env {i) - T nasal _ muc [t)) = —k - A- AT(t) (4) 

where Q is the thermal energy in joules, k is the heat transfer coefficient, A is the 
surface area of the heat being transferred (internal surface area of the nasal cavity), 
^nasai-muc is the temperature of the nasal cavity tissue (~32°C) and T env is the tempera- 
ture of the environment; i.e. the temperature that is a suitable distance from the sur- 
face (inflow air) and AT(t) = T nasa i_ muc (t)-T env (t) is the time-dependent thermal 
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Figure 6 Physical parameter interaction in respiration thermal signature. Interaction of the physical 
parameters that contribute to the detection of the respiration thermal signature (®MedlT, 2011). 
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gradient between the environment and the object [19,28]. The radiation heat transfer 
Q rad at the nostrils region is equal to 



where e is the emissivity of the nasal tissue, T nasai is the nasal tissue temperature, T c 
is the surrounding's temperature and A c is the nasal tissue area. Consequently, the 
change in overall heat transfer energy leads to a dynamic change of air temperature 
and blood perfusion throughout the respiration cycle; therefore, the thermal signature 
develops within this cycle [18,28]. For the blood perfusion heat transfer, the blood acts 
as a local distributed, scalar source (or sink) of energy with a magnitude equal to: 



where p bi and C bi are the blood perfusion rate, density and specific heat, respec- 
tively; k < 1 is a factor accounting for the incomplete thermal equilibrium between 
blood and tissue; and T art and T tissue are the arterial blood and tissue temperatures, 
respectively. The variable IR signature approximation which applies calculation of the 
maximal thermal contrast index (MTCI), which is denoted as C(t), is expressed as the 
principal parameter in pulsed thermography [17,21,22]. Therefore, this contrast index 
C(t) can be defined as follows: 



where T 0 is the temperature at initial time, where temperature is minimal and T d is 
the temperature at final time, when temperature is maximal and a cai is the thermal 
camera calibration coefficient, which is adjusted according to the clinical thermo- 
graphic setting. 

IRTR signal wavelet analysis 

Continous wavelet transform (CWT) as introduced in [26,27] was applied to the IRTR 
signals. Essentially, the Debauchies (Db-wavelet) function was used with three decom- 
position levels [29]. The Db-wavelet was chosen instead of other functions (such as 
Haar, Biorthogonal and Morlet wavelets) because the Db-transformation is known to 
provide stable and accurate decomposition results for biomedical signals [26,29]. Thus, 
the thermal variation function f(t) is transformed as follows: 



Q md (t) = e-a-A c -(T i msal -T?) 



(5) 



Qperfit) = g ■ pbi ■ Cm ■ (1 - k) ■ {T art {t) - T tisme {t)) 



(6) 



C(t) = a cd ■ (T d (t) - T o (0) 



(7) 




(8) 



where 




(9) 



Furthermore, the Fourier transform of the wavelet function ^(t) is given by: 




(10) 



Eq. (10) implies that ¥(&>) = 0 provided that co = 0 and the dot symmetry condition 
is met, otherwise it is equal to 1 [30]. The function ^(t) is called the "mother wavelet". 
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By shifting in time and dilating or compressing this function in frequency domain, one 
obtains a set of self-similar functions 

V{a,b){t) = ) (11) 

a 

where a « of 1 is the scale that provides dilating or compressing, (b) is a time shift, 
and (t) is time. In contrast to discrete wavelet transform (DWT), large scales in CWT 
relate to the coarse representation of a signal, whereas small scales constitute its fine 
details [26,28,29]. Therefore, the definition of CWT entropy (WE) for an IRTR signal 
is: 

WE=-J2p(a)log2p{a) (12) 

a 

where p(a) is the probability distribution of IRTR signal at level (a). Therefore, the 
distribution can be approximated as: 

P(a) = (13) 

Etotal 

where E(a) is wavelet energy at level (a) calculated by 

E{a) = J2\WT\ 2 {a,b) (14) 

b 

where WT represents an orthonormal basis for wavelet transformation. Therefore, 
the total signal energy (E toto/ ) is 



-total 



(15) 



Figure 7 illustrates the continous wavelet analysis of the IRTR signal extracted from 
ROI defined over the neonate nostrils, where the analysis performed over one minute 
interval. 



Neonatal respiration monitoring in the NICU 

To the authors' knowledge, this is the first time that IRTR signal analysis has been 
applied to monitor neonates. Note that special clinical challenges are present because 
measurements take place in the NICU while patients may be highly vulnerable and 
physiologically unstable. Therefore, the configuration of the measurement setup should 
be such that it interferes in no way with any routine care procedures for the neonate. 
In some of the measurements, the ROI was taken over the baby's mouth, in order to 
quantify and detect the heat transfer pattern through the respiration phases [31]. This 
occurs mainly in CPAP or mechanical ventilation, or due to the inability to directly 
image the nostrils. However, in most spontaneously breathing neonates we focused on 
the nasal region (Figure 8 and Figure 9). As a reference, we recorded other vital signs 
such as ECG, heart rate and respiration rate, derived from the bedside intensive care 
monitoring module [31,32]. The temperature time course detected from neonate's nos- 
tril region is shown in Figure 10 (b), for a female neonate wearing a face mask and an 
ROI defined around her mouth cared inside a convective incubator (note the super- 
posed temperature drifts due to changes in the internal temperature of the incubator). 
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Figure 7 IRTR signal wavelet analysis. Wavelet analysis of the IRTR signal extracted from the region of 
the nostrils of a neonate during a one-minute interval. 



In the temperature signal derived from IR thermography, a temperature change of 0.5° 
C to 0.85°C related to the respiration rate thermal signature was visible (see Figure 10). 
In addition, actions of the nurse (e.g. opening the incubator door, handling of the 
baby) also influenced the temperature profile. Another important result is the reflec- 
tion pattern of the air-jet stream on the reflective IR material (made of cotton) around 
the baby's face; when the baby exhaled air, the IR reflection signature can be clearly 
seen with this domain (although this is not quantitative but qualitative by nature). Fig- 
ure 9 (top) illustrates a neonate placed under an IR radiant warmer with ROI defined 
over his nostrils with a good detected IRTR signature. In our study, most measure- 
ments were performed with newborn infants being subject to IR radiant warming 
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(d) 



Figure 9 IRTR image over neonate's nostrils. Top: Neonatal infrared thermographic image with (a) IRTR 
signal with <5T = 0.27°C between inspiration and expiration (b) ROI located over the nostrils from which 
signal in (a) derived. Bottom: Thermal contour plot of the thermography clearly showing the thermal 
signature over this region at (c) inspiration phase starting and (d) at the expiration phase starting. 



(a) 

ROI defined over 
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ROI-respiration waveform during incubator opening Incubator door closed 
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24 
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Figure 10 IRTR signal of defined ROI temperature trend over neonate's mouth, (a) Neonatal infrared 
thermographic imaging inside a neonatal incubator with the ROI around the mouth opening, (b) 
Fluctuating temperature trend of the neonate during normal activities of daily care. 
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therapy (see Figure 11). We noted that the process of IRTR signal detection in the 
neonate is more complex than in adults due to the following problems: 

1. small air-flow jet in the neonatal respiration cycle and small lung volume 

2. the possibility that part of neonatal IRTR signature located at other infrared 
spectral band, in which the current camera system is unable to detect the full varia- 
tion in thermal energy 

3. the geometry of the nasal aperture, i.e. the inner surface area of the nasal aper- 
ture (nostrils), is small (about 0.08 cm 2 as compared with about 1.07 cm 2 in the 
average adult). 

4. the small amount of mucous secretion from the nasal cavity compared to adults 

5. low humidity level in the nostrils region of the neonate 

In fact, all factors mentioned above may reduce the amplitude of the IRTR signal. 
Therefore, some remaining problems need to be addressed in future investigations and 
further improvements should be performed taking into account the following: a) 
extending patient population (number of neonates considered in the study) to make 
more quantitative analysis, b) using more precise IR detector with high temperature 
resolution. 

Results and Discussion 

In summary, the results presented here indicate that the IRTR thermal signature detec- 
tion may be included into the future neonatal monitoring modalities. At present, the 
results acquired during IRTR measurement are not fully categorized and need more 
reliable measurement protocols. Additionally, the neonatal IRTR measurement are not 
correlated with a classical reference respiration sensing method, i.e. a thermistor that is 
fixed above the upper lip directly in front of the nares with the danger of inducing 
apnoeas because of upper airway obstruction. To overcome this problem, the neonate's 
respiration rate was manually registered from the bedside monitor. The disadvantage is 




Figure 11 Series of IRTR image during open care procedure Images of the IRTR signal detection 
process in the neonate. The sequence indicates tracking of one respiration cycle for 1 100 ms; this interval 
is not fixed over the measurement period of time, but varies according to the physiological and clinical 
status of the neonate. 
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that there is no information about the quality of breathing. The results from this 
experiment have shown clear changes in temperature over the nasal region and also a 
difference during inspiration and expiration. In addition, in some subjects averaging 
IRTR signals did not improve the signal quality and required further pre-procesing. By 
examining Figure 9, we notice that, for clinically stable infants (i.e. under IR radiant 
warmer), the IRTR signal magnitude is relatively higher than that of neonates cared 
inside convective incubator units (see Additional file 1: Neonatal IRTR video sample 
1). Moreover, while changes in convective heat transfer due to respiration in adults are 
easily observed using an IR camera, respiration monitoring in the preterm infant 
remains a challenge due to a much smaller breathing temperature variation (see Figure 
10 and Figure 12), and to other complex interactions (e.g. CPAP with face masks or 
prongs, mechanical ventilation, head rotation, motion artifacts, etc.) (see Figure 9) [26]. 
In addition, the detected IRTR signature depend also on the viewing angle set for the 
IR camera (see additional file 2: Neonatal IRTR video sample 2). Therefore, an optimal 
viewing angle will result in better quality of IRTR signature (see Figure 11). Regarding 
the standard reference measurement with IRTR signal, it seems there is also slight 
delay between the respiration signals derived from bedside ECG monitoring and the 
IRTR measurement (see Table 1). Therefore, by considering a lot of variation between 
each method, we state that the quality of the IRTR method approaches the established 
respiration activity recording using standard clinical measurement (e.g. ECG). Addi- 
tionally, our finding regarding the small temperature difference over nostril region is 
already shown in Table. 1, were the maximum difference in temperature was about 
0.66°C. 

In conclusion, whereas respiration jet and nostril temperature monitoring has been 
applied to adult volunteers, in this work IR thermography was shown to allow non- 
contact respiratory monitoring in neonates inside the NICU. Physically, the work is 
based on changes of convective heat transfer at the infra-nasal region, induced by 
breathing in dedicated ROIs. Until now the method seems more effective in adults 
than in newborns, due to the larger lung volumes in adults. Both the IR imaging device 
and the method itself still face drift problems due to variation in background tempera- 
tures. This requires improvements in image processing and boundary detection of the 
nasal region separated from the rest of the imaging scenario (e.g. incubator internal 
wall, mattress, and other facial regions). Moreover, the presented results are 




Figure 12 IRTR signal of neonate under open therapy (IR radiant warmer). (Left) Neonatal respiration 
monitoring acquired from a newborn infant under the intensive open-care system, indicating that the 
respiration thermal signature is difficult to detect unless there is a good calibration and image zooming 
functions to identify temperature variation during the inspiration-expiration phases. (Right) Time graph of 
the ROI temperature profile over the nasal region, extracted and recorded for about 60 seconds. 
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Table 1 Comparison of mean respiratory rate during 5-minute measurements derived 
from the IRTR method and from conventional ECG measurement 



IRTR respiration derived parameters 


Subj 


RR (IRTR) [bpm] 


RR (ECG) [bpm] 


Minimum ROI temp [°C] 


Maximum ROI temp [°C] 


1 


42.50 


40.36 


32.23 


32.85 


2 


44.25 


42.60 


32.11 


32.77 


3 


39.40 


38.60 


33.26 


33.49 


4 


45.14 


45.20 


32.18 


32.45 


5 


53.32 


52.09 


32.31 


32.85 



preliminary and need further studies in a larger number of neonates and under differ- 
ent care setups. The mathematical method needs further improvement, such as auto- 
matic ROI definition and automatic calibration. Furthermore, the IRTR monitoring 
may assist in the estimation of a possible temperature loss as a part of thermoregula- 
tion, and may be also considered as a first step to evaluate non-invasive respiratory 
behaviour of premature infants [33]. In comparison to the ECG derived respiration 
rate, the IRTR signal is correlated to this acquired signal from bedside monitor, while 
there is a slight difference in respiration rate estimated from each method (see Table 
1). The main impediments to high resolution IRTR signature detection are the IR cam- 
era physical coverage and the thermal detector's resolution. In spite of the calibration 
mechanism in modern thermal cameras, most of medical IR imaging setups face cali- 
bration drift; and this needs enhancement in order to avoid erroneous measurement. 
To deal with this problem, the proposed solution is based on a virtual sensing mechan- 
ism to track the ROI over a defined anatomical part. Moreover, the information on 
intensity was extracted and transformed into a corresponding color-coded space of IR 
thermographic images. 

Conclusions 

However, despite the limited number of measurements, these preliminary results pro- 
vide a good basis for further investigation of the neonatal thermal respiration signature. 
More studies performed under standardized clinical conditions are needed, so that the 
method can be applied to examine the symmetrical pattern of the IRTR signature. 
Moreover, clinical investigations should explore a range of upper respiratory tract dis- 
eases. Furthermore, this method may be an effective quantitative technique to measure 
the nasal symmetrical air-flow pattern in preterm infants. This possibly can give infor- 
mation about the depth and the frequency of each breath cycle to get an early sign of 
changes in the infant's behavior. Also, the temperature difference up to 0.66°C can be 
interpreted as a part of the infant's thermoregulation and gives an interference of heat 
loss through expiration. Despite the remaining problems, the authors feel that the pre- 
sented technique is a promising and effective step toward establishing cable-free moni- 
toring of infants under intensive care conditions. 

Statement of consent 

An oral consent was gained from the parents of the patient for publication of images 
and related files. 
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Additional material 



Additional file 1: Neonatal IRTR video sample 1 - Neonatal respiration detection with IR thermography- 
Video 1. This file is an audivisual file which illustrates the infrared thermography frame-sequence for detecting 
respiration thermal siganture from the nostrils region. This video file is taken through the preliminary clinical study 
on neonates cared in radiant warmer (open therapy). 

Additional file 2: Neonatal IRTR video sample 2 - Neonatal respoiration detection with IR thermography- 
Video 2. This file is an audivisual file which illustrates the infrared thermography frame-sequence for detecting 
respiration thermal siganture from the nostrils region. This video file is taken through the preliminary clinical study 
on neonates cared inside convective incubator system (closed therapy). 



Acknowledgements 

We hereby express our thanks to Prof. V. Blazek and Prof. V. J. Kumar for their valuable recommendation and 
reviewing of this paper. All experimental device (IR camera and temperature sensors were provided by MedIT, RWTH 
Aachen University. In addition, we thank all the medical staff in the Departement of Neonatology at University 
Hospital, RWTH Aachen University, for their tolerance and support during the study and clinical measurements. 

Author details 

1 Philips Chair for Medical Information Technology, RV\^~H Aachen University, Pauwelsstr. 20, 52074 Aachen, Germany, 
department of Neonatology, RWTH Aachen University Hospital, Pauwelsstr. 30, 52074 Aachen, Germany. 

Authors' contributions 

AK conducted the experimental work and analysis of the thermography data, in addition he wrote the article 
(technical part) together with KH (clinical part). KJ and KH performed the clinical study at the Neonatal Intensive Care 
Unit (NICU). Prof. TO and Prof. SL supervised and coordinated the whole clinical and analytic work of this paper and 
carefully revised the paper. All authors read and approved the final manuscript. 

Competing interests 

The authors declare that they have no competing interests. 

Received: 2 June 201 1 Accepted: 20 October 201 1 Published: 20 October 201 1 

References 

1. Murthy JN, van Jaarsveld J, Fei J, Pavlidis I, Harrykissoon R, Lucke : Thermal infrared imaging: A novel method to 
monitor airflow during polysomnography. SLEEP 2009, 32:1521 1527. 

2. Wang JQ, Wang HB, Jin XJ, Yang GS, Yang B, Dong XZ, Qiu LJ: The study on non-contact detection of breathing and 
heartbeat based on radar principles. Fourth Medical Military conference 2001, 25:132-135. 

3. de Chazal P, O'Hare E, Fox N, Heneghan C: Assessment of sleep/wake patterns using a non-contact biomotion 
sensor. In Conf Proc IEEE Eng Med Biol Soc 2008, 33:514-517, IEEE. 

4. Matthews G, Sudduth B, Burrow M: A non-contact vital signs monitor. Crit Rev Biomed Eng 2000, 28(1 -2):1 73-1 78. 

5. Droitcour AD, Seto TB, Park BK, Yamada S, Vergara A, Hourani CE, Shing T, Yuen A, Lubecke VM, Boric-Lubecke O: Non- 
contact respiratory rate measurement validation for hospitalized patients. Conf Proc IEEE Eng Med Biol Soc 2009 
2009, 24:4812-4815. 

6. Hafner N, Mostafanezhad I, Lubecke VM, Boric-Lubecke O, Host-Madsen A: Non-contact cardiopulmonary sensing with 
a baby monitor. Conf Proc IEEE Eng Med Biol Soc 2007, 12:2300-2302. 

7. Zito D, Pepe D, Mincica M, Zito F, Rossi DD, Lanata A, Scilingo EP, Tognetti A: Wearable system-on-a-chip UWB radar 
for contact-less cardiopulmonary monitoring: present status. Conf Proc IEEE Eng Med Biol Soc 2008, 14:5274-5277, 
IEEE. 

8. Matsui T, Hattori H, Takase B, Ishihara M: Non-invasive estimation of arterial blood pH using exhaled CO/C02 
analyzer, microwave radar and infrared thermography for patients after massive hemorrhage. J Med Eng Technol 
2006, 30:97-101. 

9. Ling E, McDonald L, Dinesen TJR, DuVall D: The OxyArm - a new minimal contact oxygen delivery system for mouth 
or nose breathing. Can J Anaesth 2002, 49(3):297-301. 

10. Hoffmann T, Eilbrecht B, Leonhardt S: Respiratory monitoring system on the basis of capacitive textile force sensor. 

IEEE transaction of sensors 2010, 27. 

11. Nakajim K, Matsumoto Y, Tamura T: Development of real-time image sequence analysis for evaluating posture 
change and respiratory rate of a subject in bed. Physiological Measurement 2001, 22(2):N21-N28. 

12. Heimann K, Steffen M, Bernstein N, Heerich N, Stanzel S, Cordes A, Leonhardt S, Wenzl TG, Orlikowsky T: Non-contact 
monitoring of heart and lung activity using magnetic induction measurement in a neonatal animal model. Biomed 
Tech (Berl) 2009, 6(54):337-345. 

13. Hoist G: Common Sense Approach to Thermal Imaging SPIE Press, JCD Publishing; 2000. 

14. Maldague X: In Theory and practice of infrared technology for nondestructive testing. Volume 2. Wiley; 2001. 

15. Kaplan H: Practical applications of infrared thermal sensing and imaging equipment Tutorial texts in optical engineering, 
SPIE Press; 2007. 

16. Hudson R: Infrared Systems Engineering John Wiley & Sons, Inc, New York; 1969. 

17. F K: The CRC Handbook of Thermal Engineering CRC Press, Boca Raton, FL; 2000. 

18. Pavilidis I, Levine J: Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine 
2002, 21(6):56-64. 



Abbas et al. BioMedical Engineering OnLine 201 1, 10:93 
http://www.biomedical-engineering-online.eom/content/10/1/93 



Page 1 7 of 1 7 



19. Tarkov MS, Vainer BG: Evaluation of a Thermogram Heterogeneity Based on the Wavelet Haar Transform. Proc 
Siberian Conference on Control and Communications SIBCON '07 2007, 145-152. 

20. Murthy R, Pavlidis I: Non-contact monitoring of breathing function using infrared imaging. Technical report in 
Biomedical engineering Number UH-CS-05-09, University of Houston; 2005. 

21. Fei J, Pavlidis I, Murthy J: Thermal vision for sleep apnea monitoring. Med Image Comput Comput Assist Interv 2009, 
12(Pt 2):1 084-1 091. 

22. Caniou J: In Passive infrared detection: theory and applications. Volume 2. Kluwer Academic Publishers; 1999. 

23. Fei J, Pavlidis I: Virtual thermistor. Conf Proc IEEE Eng Med Biol Soc 2007, 250-253. 

24. Fei J, Pavlidis I: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans Biomed Eng 2010, 
57(4):988-998. 

25. Naftali S, Schroter RC, Shiner RJ, Elad D: Transport Phenomena In The Human Nasal Cavity: A Computational Model. 

Annals of Biomedical Engineering 1998, 26(5):83 1-839. 

26. Abbas AK, Heimann K, Orlikowsky T, Leonhardt S: Non-Contact Respiratory Monitoring Based on Real-Time IR- 

Thermography. In World Congress on Medical Physics and Biomedical Engineering,, IFMBE Proceedings Edited by: IFMBE 
2010, 25. 

27. Fei J, Pavlidis I: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans Biomed Eng 2010, 
57(4):988-998[http://dx.doi.org/10.1109/TBME.2009.2032415]. 

28. Danjoux R: The evolution in spatial resolution. InfraMation Magazine 2001, 2(1 2):1 -3. 

29. Akay M, Mello C: Wavelets for biomedical signal Processing. In Proceedings of the 19th annual international conference 
of the IEEE Edited by: engineering in medicine, biology society 1997, 6. 

30. Stark H: Wavelets and signal processing: an application-based introduction Springer; 2005 [http://books.google.com/ 
books?id=IYUMyVRdJjkC]. 

31. Bohnhorst B, Heyne T, Peter C, Poet sC: Skin-to-skin (kangaroo) care, respiratory control, and thermoregulation. J 

Pediatr 200], 138:193-197. 

32. Bohnhorst B, Gill D, Drdelmann M, Peter C, Poets C: Bradycardia and desaturation during skin-to-skin care: no 
relationship to hyperthermia. J Pediatrics 2004, 145:499-502. 

33. Heimann K, Vaen P, Peschgens T, Stanzel S, Wenzl T, Orlikowsky T: Impact of skin-to-skin care, prone and supine 
positioning on cardio respiratory parameters and thermoregulation in premature infants. Neonatology 2010 2010, 
97:311-317. 



doi:1 0.1 1 86/1 475-925X-1 0-93 

Cite this article as: Abbas et al:. Neonatal non-contact respiratory monitoring based on real-time infrared 
thermography. BioMedical Engineering OnLine 201 1 10:93. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 



• Convenient online submission 



• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at 
www.biomedcentral.com/submit 




